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(54) Recording medium having recorded data structure and method and apparatus of 
recording/reproducing using the data structure 



(57) A recording medium recorded by a data struc- 
ture capable linking and reproducing audio data and vid- 
eo data, a method and apparatus of recording/reproduc- 
ing using the data structure are provided. On the record- 
ing medium, first data (31) and second data (41), which 
are different to each other in type and formed of a plu- 
rality of data units, are recorded; a first data unit descrip- 
tor table (32) and a second data unit descriptor table 
(42) in which information on the first data units and the 
second data units are respectively recorded as data unit 
descriptors, are recorded; and a first program descriptor 



table (33) and a second program descriptor table (43) 
in which information on one or more data units forming 
respective programs are stored in the program descrip- 
tor of the corresponding program in the form of informa- 
tion on respective data unit descriptors, are recorded, 
wherein information on the first data units which are 
wanted to reproduce after linked to the second data 
units is included in the program descriptor of the second 
program descriptor table. By doing so, using independ- 
ent data structures for respective independent applica- 
tion, generation of a new application linking two inde- 
pendent data structures is enabled. 
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Description 

[0001] The present invention relates to audio/video 
(A/V) data recording/reproducing, and more particularly, 
to a single recording medium on which is recorded a da- 
ta structure and to a method and apparatus for record- 
ing/reproducing using the data structure. 
[0002] In the existing data structures for recording, as 
shown in Figure 1 , the video data structure and the audio 
data structure are independent each other. That is, the 
structure of data and information for a video program is 
made of video data 1 1 , a video data descriptor table 1 2, 
and a video program descriptor table 1 3, and likewise, 
the structure of data and information for an audio pro- 
gram is made of audio data 21 , an audio data descriptor 
table 22, and an audio program descriptor table 23. 
[0003] Since audio data and video data are recorded/ 
reproduced separately as shown in Figure 1, separate 
recording/reproducing apparatuses exist for each type 
of data. Each recording/reproducing apparatus sepa- 
rately generates and records information (a data de- 
scriptor table, and a program descriptor table) on data 
the apparatus records. 

[0004] In the linkage relation between video data and 
information data shown in Figure 1, video data 11 is 
made of a plurality of video data units as shown in Figure 
2. A video data unit descriptor for each video data unit 
is recorded in the video data descriptor table 1 2. When 
programs are made of one or more video data units, 
such information is recorded in each program in the vid- 
eo program descriptor table 1 3, and information on one 
or more video data units forming each program is re- 
corded in the program descriptor of the corresponding 
program in the form of information on a video data unit 
descriptor. Program descriptors are recorded in a video 
program descriptor table 13. 

[0005] Figure 3 shows the linkage relation between 
audio data and information data shown in Figure 1 , and 
illustrates the data structure for recording/reproducing 
audio data, which is separate from the data structure for 
recording/reproducing video data shown in Figure 2. 
[0006] Like the structure of video data and information 
data, audio data 21 is made of a plurality of audio data 
units. An audio data unit descriptor having information 
on each audio data unit is recorded in an audio data de- 
scriptor table 22. When programs are made of one or 
more audio data units, information on one or more data 
units forming each program is recorded in the program 
descriptor of the corresponding program in the form of 
information on an audio data unit descriptor. That is, au- 
dio program descriptors are recorded in an audio pro- 
gram descriptor table 23. 

[0007] In existing recording structures, on one record- 
ing medium, the structure of which data and information 
for a video program is contained, and a separate video 
recording/reproducing apparatus performing recording 
and/or reproducing of the video program using the in- 
formation structure exists. At the same time, independ- 



ently of this structure, the structure of data and informa- 
tion for an audio program is recorded on the recording 
medium, and a separate audio recording/reproducing 
apparatus performing recording and/or reproducing of 

5 the audio program using the information structure ex- 
ists. These two structures are independent of each oth- 
er, and each recording/reproducing apparatus performs 
recording/reproducing operations independently, with- 
out considering the other's data and information struc- 

10 ture. 

[0008] A recording/reproducing apparatus using such 
a data and information structure can record/reproduce 
both video data and audio data, but cannot perform an 
operation in which two types of data are linked and then 

is reproduced. For example, the apparatus cannot per- 
form a so-called slide show operation, in which a song 
recorded in audio data is reproduced and at the same 
time, a plurality of still pictures recorded in video data 
are reproduced. This has been a problem. 

20 [0009] With a view to solve or reduce the above prob- 
lems, it is an aim of embodiments of the present inven- 
tion to provide a recording medium on which is recorded 
a data structure having a new application which links 
two independent data structures using an independent 

25 data structure for an independent application. 

It is another aim to provide a recording medium on 
which is recorded a data structure capable of linking and 
reproducing audio data and related video data when au- 
dio data is reproduced. 

30 [0010] It is another aim to provide a method for gen- 
erating a new application which links two independent 
data structures, using an independent data structure for 
an independent application. 

[0011] It is another aim to provide a method for gen- 

35 erating and recording new information linking two types 
of data, audio data and video data, using information on 
each of the two types of data. 
[001 2] It is another aim to provide a method for updat- 
ing new information linking two types of data, audio and 

40 video data, in order to always show the latest informa- 
tion on recorded audio and video data. 
[0013] It is another aim to provide a method for simul- 
taneously reproducing audio data and video data, using 
new information linking the two types of data. 

45 [0014] It is another aim to provide a recording appa- 
ratus for recording new information so that two types of 
data are linked and reproduced in an audio/video player 
after recording video data with a video recorder and re- 
cording audio data with an audio recorder. 

so [0015] It is another aim to provide a reproducing ap- 
paratus for simultaneously reproducing two types of da- 
ta, using new information linking the two types of data 
on a recording medium on which video data and audio 
data are recorded. 

55 [0016] It is another aim to provide a recording/repro- 
ducing apparatus for simultaneously reproducing two 
types of data, using new information in reproducing, af- 
ter recording new information in an audio/video player 
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so that the two types of data can be linked and repro- 
duced, after video data is recorded using a video record- 
er and audio data is recorded using an audio recorder 
when data is recorded. 

[001 7] According to a first aspect of the present inven- 
tion, there is provided a recording medium on which is 
recorded a data structure comprising: first data and sec- 
ond data which are different to each other in type and 
formed of a plurality of data units; a first data unit de- 
scriptor table and a second data unit descriptor table in 
which information on the first data units and the second 
data units are respectively recorded as data unit de- 
scriptors; and a first program descriptor table and a sec- 
ond program descriptor table in which information on 
one or more data units forming respective programs are 
stored in the program descriptor of the corresponding 
program in the form of information on respective data 
unit descriptors, wherein information on the first data 
units, which are wanted by a user to reproduce after the 
first data units are linked to the second data units, is 
included in the program descriptor of the second pro- 
gram descriptor table. 

[0018] Preferably, the first data is video data of still 
pictures and the second data is audio data. 
[0019] Preferably, predetermined information in the 
first data unit descriptor is copied, as information on the 
first data unit, to the program descriptor of the second 
program descriptor table. 

[0020] Preferably, the predetermined information is 
information on the recording time of the first data unit. 
[0021] Preferably, when information on the first data 
unit in the second program descriptor table is not the 
same as the corresponding information on the first data 
unit in the first data unit descriptor, information on the 
first data unit in the second program descriptor table is 
updated so that the information is the same as informa- 
tion on the first data unit in the first data unit descriptor. 
[0022] According to a second aspect of the invention, 
there is provided a recording method comprising the 
steps of: 

(a) recording first data and second data, which are dif- 
ferent to each other in type and formed of a plurality of 
data units, on a recording medium; and (b) recording a 
first data unit descriptor table and a second data unit 
descriptor table wherein information on the first data 
units and the second data units is stored as data unit 
descriptors; and a first program descriptor table and a 
second program descriptor table wherein information on 
one or more data units forming respective programs are 
stored as the program descriptor of the corresponding 
program in the form of information on respective data 
unit descriptors, on the recording medium, wherein in- 
formation on the first data unit, which is wanted by a user 
to reproduce after the first data unit is linked to the sec- 
ond data unit, is included in the program descriptor of 
the second program descriptor table. 
[0023] Preferably, the first data is video data of still 
pictures and the second data is audio data. 



[0024] Preferably, predetermined information of the 
first data unit descriptor is copied to and recorded in the 
program descriptor of the second program descriptor ta- 
ble, as information on the first data unit. 

5 [0025] Preferably, the predetermined information is 
information on recording time of the first data unit. 
[0026] The recording method may further comprise 
the steps of: (c) determining whether or not information 
on the first data unit in the second program descriptor 

10 table is the same as information on the first data unit in 
the first data unit descriptor; and (d) when the two infor- 
mation are not the same, updating information on the 
first data unit in the second program descriptor table so 
that it becomes the same as information on the first data 

15 unit in the first data unit descriptor, and recording the 
updated information. 

[0027] According to a third aspect of the invention, 
there is provided a reproducing method for reproducing 
data from a recording medium on which first data and 

20 second data which are different to each other in type 
and formed of a plurality of data units are recorded; a 
first data unit descriptor table and a second data unit 
descriptor table, in which information on the first data 
units and the second data units are respectively stored 

25 as data unit descriptors, are recorded; and a first pro- 
gram descriptor table and a second program descriptor 
table in which information on one or more data units 
forming respective programs are stored in the program 
descriptor of the corresponding program in the form of 

30 information on respective data unit descriptors, wherein 
in the program descriptor of the second program table 
information for linking the first data and the second data 
are recorded, the reproducing method comprising the 
steps of: (a) reading the second program descriptor hav- 

35 ing information on the program wanted to reproduce, 
and then reading information the first data unit descrip- 
tor and the second data unit descriptor related to the 
corresponding program, from the read second program 
descriptor; (b) reading the corresponding data unit de- 

40 scriptors from the first and second data descriptor tables 
corresponding to the read first and second data unit de- 
scriptors; and (c) synchronizing and reproducing the first 
data unit and the second data unit indicated by the read 
first and second data unit descriptors. 

45 [0028] Preferably, the step (c) further comprises the 
sub-steps of: (d) temporarily storing the first data units 
indicated by the first data unit descriptors corresponding 
to the wanted program, to a memory; and (c2) reproduc- 
ing the second data units indicated by the second data 

so unit descriptors corresponding to the wanted program, 
and at the same time synchronizing, to the second data, 
and reproducing the first data units after reading the first 
data units stored in the memory. 
[0029] The first data is preferably video data of still 

55 pictures and the second data is audio data. 

[0030] Preferably, information on the first data unit, 
which is wanted by a user to reproduce after the first 
data unit is linked to the second data unit, is stored, as 
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linkage information, in the program descriptor of the sec- 
ond program descriptor table, and predetermined infor- 
mation in the first data unit descriptor is copied, as the 
information on the first data unit, to the program descrip- 
tor of the second program descriptor table. 
[0031] Preferably, the predetermined information is 
information on the recording time of the first data unit. 
[0032] The reproducing method may further comprise 
the steps of: (d) determining whether or not information 
on the first data unit in the second program descriptor 
table is the same as information on the first data unit in 
the first data unit descriptor; and (e) when the two infor- 
mation are not the same, updating information on the 
first data unit in the second program descriptor table so 
that it becomes the same as information on the first data 
unit in the first data unit descriptor, and recording the 
updated information. 

[0033] The reproducing method may further comprise 
the steps of: (d) determining whether or not information 
on the first data unit in the second program descriptor 
table is the same as information, which corresponds to 
the information on the first data unit, on the first data unit 
in the first data unit descriptor; and (e) when the two 
information are not the same, reproducing the second 
data unit while withholding reproduction of the first data 
unit. 

[0034] According to a fourth aspect of the invention, 
there is provided a recording apparatus for recording da- 
ta of different types on a recording medium, the record- 
ing apparatus comprising: a first signal processor for for- 
matting a first data stream input into independent units, 
coding the formatted first data units, and providing them 
to the recording medium; a second signal processor for 
formatting a second data stream input into independent 
units, coding the formatted second data units, and pro- 
viding them to the recording medium; and a system con- 
troller for generating a first data unit descriptor table and 
a second data unit descriptor table in which information 
on the first data units and the second data units are re- 
spectively stored as data unit descriptors; and a first pro- 
gram descriptor table and a second program descriptor 
table in which information on one or more data units 
forming respective programs are stored in the program 
descriptor of the corresponding program in the form of 
information on respective data unit descriptors, wherein 
information on the first data unit, which is wanted by a 
user to reproduce after linked to the second data unit, 
is included in the program descriptor of the second pro- 
gram descriptor table. 

[0035] Preferably, the first data is video data of still 
picture and the second data is audio data. 
[0036] Preferably, predetermined information of the 
first data unit descriptor, as information on the first data 
unit, is copied to the program descriptor of the second 
program descriptor table. 

[0037] Preferably, the predetermined information is 
information on recording time of the first data unit. 
[0038] Preferably, the system controller determines 



whether or not information on the first data unit in the 
second program descriptor table is the same as the cor- 
responding information on the first data unit in the first 
data unit descriptor, and, when two information are not 
5 the same, information on the first data unit in the second 
program descriptor table is updated so that the informa- 
tion is the same as information on the first data unit in 
the first data unit descriptor. 

[0039] According to a fifth aspect there is provided a 
10 reproducing apparatus for reproducing data from a re- 
cording medium on which first data and second data, 
which are different to each other in type and formed of 
a plurality of data units, are recorded; a first data unit 
descriptor table and a second data unit descriptor table, 
15 which include data unit descriptors having information 
on respective data units, are recorded; and a first pro- 
gram descriptor table and a second program descriptor 
table in which information on one or more data units 
forming respective programs are stored in the program 
20 descriptor of the corresponding program in the form of 
information on respective data unit descriptors, are re- 
corded, wherein information for linking the first data and 
the second data is recorded in the program descriptor 
of the second program table, the reproducing apparatus 
25 comprising: a system controller for reading the second 
program descriptor having information on the program 
wanted by a user to reproduce, reading information on 
the first data unit descriptor and the second data unit 
descriptor related to the corresponding program from 
30 the read second program descriptor, and reading corre- 
sponding data unit descriptors from the first data de- 
scriptor table and the second data descriptor table cor- 
responding respectively to read information on the first 
data unit descriptor and the second data unit descriptor; 
35 a first signal processor having an embedded memory, 
and for temporarily storing the corresponding first data 
unit indicated by the read first data unit descriptor to the 
memory, decoding the first data unit stored in the mem- 
ory, and reproducing the decoded first data after adjust- 
40 ing its timing to that of the second data unit; and a sec- 
ond signal processor for decoding the corresponding 
second data unit indicated by the read second data unit 
descriptor and reproducing the decoded second data. 
[0040] The first data may be video data of still ptc- 
45 tures, and the second data is audio data. 

[0041] Preferably, information on the first data unit 
which is wanted by a user to reproduce after the first 
data unit is linked to the second data unit is stored, as 
linkage information, in the program descriptor of the sec- 
50 ond descriptor table, and predetermined information in 
the first data unit descriptor is copied, as information on 
the first data unit, to the program descriptor of the sec- 
ond descriptor table. 

[0042] Preferably, the predetermined information is 
55 information on the recording time of the first data unit. 
[0043] Preferably, the system controller determines 
whether or not information on the first data unit in the 
second program descriptor table is the same as the cor- 
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responding information on the first data unit in the first 
data unit descriptor, and, when two information are not 
the same, information on the first data unit in the second 
program descriptor table is updated so that the informa- 
tion is the same as information on the first data unit in 
the first data unit descriptor. 

[0044] Preferably, the system controller determines 
whether or not information on the first data unit in the 
second program descriptor table is the same as the cor- 
responding information on the first data unit in the first 
data unit descriptor, and, when two information are not 
the same, the second data unit is reproduced while the 
reproduction of the first data unit is withheld, 
[0045] Preferably, the memory is installed outside the 
first signal processor. 

[0046] According to a sixth aspect, there is provided 
an audio-reproduction-dedicated apparatus for repro- 
ducing data from a recording medium on which first data 
and second data which are different to each other in type 
and formed of a plurality of data units are recorded; a 
first data unit descriptor table and a second data unit 
descriptor table, which include data unit descriptors hav- 
ing information on respective data units, are recorded; 
and a first program descriptor table and a second pro- 
gram descriptor table in which information on one or 
more data units forming respective programs are stored 
in the program descriptor of the corresponding program 
in the form of information on respective data unit de- 
scriptors, are recorded, wherein information for linking 
the first data and the second data is recorded in the pro- 
gram descriptor of the second program table, the audio- 
reproduction-dedicated apparatus comprising: a sys- 
tem controller for reading the second program descrip- 
tor having information on the program wanted by a user 
to reproduce, reading information on the second data 
unit descriptor related to the corresponding program 
from the read second program descriptor, and reading 
corresponding data unit descriptors from the second da- 
ta descriptor table corresponding to read information on 
the second data unit descriptor; and a signal processor 
for decoding the corresponding data unit indicated by 
the read second data unit descriptor and reproducing 
the second data. 

[0047] According to a seventh aspect, there is provid- 
ed a recording/reproducing apparatus comprising: a first 
signal processor for formatting a first data input into in- 
dependent units and coding the formatted first data units 
during recording; and for temporarily storing the corre- 
sponding data unit indicated by the read first data unit 
descriptor to an embedded memory, decoding the first 
data unit read from the memory, and, during reproduc- 
tion, reproducing the decoded first data after adjusting 
its timing to that of a second data unit; a second signal 
processor for formatting a second data input into inde- 
pendent units and coding the formatted second data 
units during recording; and, during reproduction, for de- 
coding the corresponding second data unit indicated by 
the read second data unit descriptor and reproducing 



the decoded second data; and a system controller for 
generating a first data unit descriptor table and a second 
data unit descriptor table storing information on the first 
data units and the second data units as data unit de~ 

5 scriptors, and a first program descriptor table and a sec- 
ond program descriptor table in which information on 
one or more data units forming respective programs are 
stored in the program descriptor of the corresponding 
program in the form of information on respective data 

10 unit descriptors wherein information on the first data unit 
wanted to reproduce after linked to the second data unit 
is included in the program descriptor of the second pro- 
gram descriptor table, during recording; and, during re- 
production, for reading the second program descriptor 

15 having information on the program wanted to reproduce, 
reading information on the first data unit descriptor and 
the second data unit descriptor related to the corre- 
sponding program from the read second program de- 
scriptor, and reading corresponding data stream unit de- 

20 scriptors from the first data descriptor table and the sec- 
ond data descriptor table corresponding respectively to 
read information on the first data unit descriptor and the 
second data unit descriptor. 

[0048] Preferably, the first data is video data of still 
25 pictures and the second data is audio data. 

[0049] Preferably, information on the first data unit 
which is wanted by a user to reproduce after the first 
data unit is linked to the second data unit is stored, as 
linkage information, in the program descriptor of the sec- 
30 ond descriptor table, and predetermined information in 
the first data unit descriptor is copied, as information on 
the first data unit, to the program descriptor of the sec- 
ond descriptor table. 

[0050] Preferably, the predetermined information is 

35 information on recording time of the first data unit. 
[0051] Preferably, the system controller determines 
whether or not information on the first data unit in the 
second program descriptor table is the same as the cor- 
responding information on the first data unit in the first 

40 data unit descriptor, and, when two information are not 
the same, information on the first data unit in the second 
program descriptor table is updated so that the informa- 
tion is the same as information on the first data unit in 
the first data unit descriptor 

45 [0052] Preferably, the system controller determines 
whether or not information on the first data unit in the 
second program descriptor table is the same as the cor- 
responding information on the first data unit in the first 
data unit descriptor, and, when two information are not 

so the same, the second data unit is reproduced while the 
reproduction of the first data unit is withheld. 
[0053] The memory may be installed outside the first 
signal processor. 

[0054] For a better understanding of the invention, 
55 and to show how embodiments of the same may be car- 
ried into effect, reference will now be made, by way of 
example, to the accompanying diagrammatic drawings 
in which: 
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Figure 1 illustrates the existing structure of video/ 
audio (A/V) data; 

Figure 2 illustrates the linkage relation between vid- 
eo tables and video data shown in Figure 1 ; 

Figure 3 illustrates the linkage relation between au- 
dio tables and audio data shown in Figure 1 ; 

Figure 4 illustrates an example of a data structure 
capable of linking and then reproducing audio data 
and video data according to an embodiment of the 
present invention; 

Figure 5 illustrates the linkage relation between ta- 
bles and data shown in Figure 1 ; 

Figure 6 is a block diagram showing an embodiment 
of an A/V recording apparatus according to the 
present invention; 

Figure 7 is a block diagram showing an embodiment 
of an A/V reproducing apparatus according to the 
present invention; 

Figure 8 is a block diagram showing an embodiment 
of an A/V recording/reproducing apparatus accord- 
ing to the present invention; 

Figure 9 is a flowchart showing an embodiment of 
a recording method for recording information linking 
audio data to video data according to the present 
invention; 

Figure 10 is a flowchart showing an embodiment of 
a method for updating information linking audio data 
to video data according to the present invention; 
and 

Figure 11 is a flowchart showing an embodiment of 
a reproducing method for linking and then reproduc- 
ing audio data and video data according to the 
present invention. 

[0055] Hereinafter, embodiments of the present in- 
vention will be described in detail with reference to the 
attached drawings. The present invention is not restrict- 
ed to the following embodiments, and many variations 
are possible within the spirit and scope of the present 
invention. The embodiments of the present invention 
are provided in order to more completely explain the 
present invention to anyone skilled in the art. 
[0056] Figure 4 illustrates an example of a data struc- 
ture capable of linking and reproducing audio and video 
data according to the present invention. Referring to Fig- 
ure 4, the data structure for a video application accord- 
ing to the present invention is made of video data 31 
formed by one or more video data units, a video data 



descriptor table 32 having video data descriptors, each 
of which is the descriptor for a corresponding video data 
unit, and a video program descriptor table 33 having vid- 
eo program descriptors that are generated when a video 

s program is formed using one or more video data units, 
[0057] Also, the data structure for an audio application 
according to the present invention is made of audio data 
41 formed by one or more audio data units, an audio 
data descriptor table 42 having audio data unit descrip- 

10 tors, each of which is the descriptor for a corresponding 
audio data unit, and an audio/video program descriptor 
table 43 (hereinafter, referred to as an A/V program de- 
scriptor table) having audio/video program descriptors 
(hereinafter, referred to as A/V program descriptors) 

is each of which is the descriptor for a corresponding pro- 
gram generated by using one or more audio data units 
and has information on the video program linked to a 
corresponding program. 

[0058] Figure 5 illustrates the linkage relation be- 

20 tween video and/or audio data and information shown 
in Figure 4. The linkage relation between video tables 
and video data shows that video data 31 is formed by a 
plurality of video data units, the same as in the existing 
structure shown in Figure 2. A video data unit descriptor 

25 for each video data unit is recorded in a video data de- 
scriptor table 32. When a program is formed by one or 
more video data units, each program records that infor- 
mation in a video program descriptor table 33. Informa- 
tion on one or more video data units forming each pro- 

30 gram is recorded in a corresponding video program de- 
scriptor in the form of information on a video data unit 
descriptor. Video program descriptors are recorded in 
the video program descriptor table 33. 
[0059] Meanwhile, audio data 41 is formed by a plu- 

35 rality of audio data units. An audio data unit descriptor 
for each audio data unit is recorded in an audio data 
descriptor table 42. When a program is formed by one 
or more audio data units, such information is recorded 
in each program in the video program descriptor table 

40 43, and information on one or more audio data units 
forming each program is recorded in the A/V program 
descriptor of the corresponding program in the form of 
information on an audio data unit descriptor. A/V pro- 
gram descriptors are recorded in an A/V program de- 

45 scriptor table 43. This method is the same as the meth- 
od, shown in Figure 3, which is used when a program 
exclusively for an audio data is generated and recorded. 
[0060] However, when an A/V program made by the 
method is to be linked to video data units and then re- 

50 produced together, information on the corresponding 
video data unit, as shown in Figure 5, that is, information 
on the video data unit descriptor, is recorded in the A/V 
program descriptor of a corresponding A/V program. 
[0061] The A/V program descriptor can be an audio- 

55 dedicated program descriptor formed by audio data de- 
scriptors, and in this case, information on the linked vid- 
eo data descriptor is not recorded in the corresponding 
A/V program descriptor. The A/V program descriptor 
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can be formed by one audio data descriptor and one or 
more video data descriptors, or by one or more audio 
data descriptors and one or more video data descrip- 
tors. 

[0062] When the data structure shown in Figure 5 is 
used, information on video data unit descriptors record- 
ed in the A/V program descriptor table 43 must show 
actual video data unit descriptors. In order to do so, pre- 
determined information in a video data descriptor table 
is copied and recorded in the A/V program descriptor 
table 43. Information that can be used to distinguish a 
video data unit from other video data units, for example, 
information on time when the corresponding video data 
unit is recorded, can be the predetermined information. 
[0063] Figure 6 is a block diagram showing an em- 
bodiment of an A/V recording apparatus according to 
the present invention. An audio input processor 102 pre- 
processes an input audio signal and then provides dig- 
ital audio data to an audio signal processor 104. The 
audio signal processor 1 04 formats the digital audio da- 
ta into audio data units of a predetermined size, and 
codes the formatted audio data units. 
[0064] Referring to Figure 5, a system controller 106 
generates each audio data unit descriptor from informa- 
tion on the corresponding audio data unit and then 
records the descriptors in an audio data unit descriptor 
table. For an A/V program using a recorded audio data 
unit, information on the corresponding audio data unit 
descriptor is recorded in the corresponding A/V program 
descriptor and the A/V program descriptor is recorded 
in an A/V program descriptor table. In order to reproduce 
audio data, which is indicated by the A/V program, to- 
gether with a video data unit which is recorded by a vid- 
eo recorder (here, a video input processor 108 and a 
video signal processor 110), information on the corre- 
sponding video data unit, that is, information on the vid- 
eo data unit descriptor, is recorded in the corresponding 
A/V program. Also, predetermined information of the 
corresponding video data unit descriptor (for example, 
information on the time when the corresponding video 
data unit is recorded) is copied and recorded in the A/V 
program descriptor table. 

[0065] A video input processor 1 08 pre-processes the 
video signal and provides digital video data to a video 
signal processor 110. A video signal processor 110 for- 
mats video data into video data units of a predetermined 
size and codes the formatted video data units. Referring 
to Figure 5, the system controller 106 generates each 
video data unit descriptor from information on the cor- 
responding video data unit and then records the descrip- 
tors in a video data unit descriptor table. For a video 
program using a recorded video data unit, information 
on the corresponding video data unit descriptor is re- 
corded in the corresponding video program descriptor, 
and the video program descriptor is recorded in a video 
program descriptor table. 

[0066] For construction of the structure shown in Fig- 
ure 4, a recording controller 112 records an audio data 



stream formed by coded audio data units provided by 
the audio data signal processor 104, and a video data 
stream formed by coded video data units provided by 
the video signal processor 110, in a predetermined lo- 

5 cation of a recording medium 114. The recording con- 
troller 1 1 2 also records a video data unit descriptor table, 
a video program descriptor table, an audio data unit de- 
scriptor table, and an A/V program descriptor table pro- 
vided by the system controller 106, in a predetermined 

io location of the recording medium 114. 

[0067] Figure 7 is a block diagram showing an em- 
bodiment of an A/V reproducing apparatus according to 
the present invention. A reproducing controller 204 
reads an audio data stream and a video data stream 

15 recorded in a recording medium 202 and provides the 
streams to an audio signal processor 208 and a video 
signal processor 212, respectively, and reads a video 
program descriptor table, a video data unit descriptor 
table, an A/V program descriptor table and an audio data 

20 unit descriptor table recorded in the recording medium 
202 and then provides them to a system controller 206. 
[0068] The system controller 206 reads the A/V pro- 
gram descriptor of an A/V program which a user wants 
to reproduce through a user interface, from the A/V de- 

25 scriptor table, and reads information on an audio data 
unit descriptor and a video data unit descriptor recorded 
in the A/V program descriptor, and then reads audio data 
unit descriptors and video data unit descriptors indicat- 
ed by the information, from the audio data descriptor ta- 

30 ble and the video data descriptor table, respectively. 
[0069] An audio signal processor 208 decodes and 
de-formats audio data units indicated by the audio data 
unit descriptor read by the system controller 206 and 
provides restored audio data. An audio output processor 

35 210 processes the restored audio data so that it can be 
used in external output devices like a speaker 
[0070] A video signal processor 212 temporarily 
stores video data units indicated by the video data unit 
descriptor read by the system controller 206, reads vid- 

40 eo data units related to audio data output from the audio 
signal processor 208 from a memory 214, and decodes 
and de-formats the read video data units to provide re- 
stored video data. Here, the memory 214 can be em- 
bedded in the video signal processor 212. A video out- 

45 put processor 21 6 processes the restored video data so 
that it can be used in external output devices like a mon- 
itor. 

[0071] Here, before or during reproduction, predeter- 
mined information of a video data descriptor recorded 

50 jn an A/V program descriptor table is compared to infor- 
mation of a video data descriptor linked to an actual vid- 
eo data descriptor table. When two information are the 
same, reproduction is carried out; otherwise reproduc- 
tion of the corresponding video unit is withheld. 

55 [0072] Also, before reproducing in an A/V reproducing 
apparatus, a recording medium is recognized and at the 
same time predetermined information on video data unit 
descriptors linked to respective programs recorded in 
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the A/V program descriptor table is compared to prede- 
termined information on video data unit descriptors re- 
corded in the video data descriptor table. When different 
parts are found in the comparison, the predetermined 
information on video data unit descriptors of the A/V pro- 
gram descriptor table is modified, that is, an operation 
for changing information on video data unit descriptors 
of the A/V program linked to the video data unit descrip- 
tors which were found to be different is carried out by 
the AA/ recording apparatus shown in Figure 6 or by the 
AA/ recording/reproducing apparatus shown in Figure 8. 
[0073] The present invention can be applied to an au- 
dio-dedicated reproducing apparatus which has no de- 
vices required for video reproduction (a video signal 
processor 21 2, a memory 21 4, and a video output proc- 
essor 216), and which uses a known recording/repro- 
ducing data structure. 

[0074] That is, the system controller of an audio-ded- 
icated reproducing apparatus reads the AA/ program 
descriptor of an A/V program a user wants to reproduce, 
from an A/V program descriptor table, reads information 
on an audio data unit descriptor recorded in the A/V pro- 
gram descriptor, and then reads the audio data unit de- 
scriptor indicated by the corresponding information, 
from an audio data descriptor table. An audio signal 
processor reads the audio data unit indicated by the 
read audio data descriptor and decodes and outputs the 
audio data. 

[0075] Figure 8 is a block diagram of an embodiment 
of an A/V recording/reproducing apparatus according to 
the present invention. When the A/V recording appara- 
tus shown in Figure 6 and the A/V reproducing appara- 
tus shown in Figure 7 are combined, except the fact that 
an audio signal processor 304, and a video signal proc- 
essor 310, a system controller 306, and a recording/re- 
producing controller 312 are commonly used, an audio 
input processor 302, a video input processor 308, an 
audio output processor 31 6, a memory, and a video out- 
put processor 320 are the same as shown in Figures 6 
and 7, and therefore an explanation on the structures 
and operations of these parts will be omitted. 
[0076] During recording, the audio signal processor 
304 formats audio data into audio data units of a prede- 
termined size, and codes the formatted audio data units, 
and during reproduction, the audio signal processor 304 
decodes and de-formats an audio data unit indicated by 
an audio data unit descriptors read by the system con- 
troller 306, to provide restored audio data. 
[0077] During recording, the video signal processor 
310 formats digital video data into video data units of a 
predetermined size, and codes the formatted video data 
units and during reproducing, the video signal processor 
310 temporarily stores video data units indicated by a 
video data unit descriptor read by the system controller 
306, to the memory 31 8, reads a video data unit related 
to the audio data output from the audio signal processor 
304, from the memory 31 8, and decodes and de-formats 
the read video data unit to provide restored video data. 



[0078] During recording the system controller 306 
generates a video data descriptor table, a video pro- 
gram table, an audio data descriptor table and an A/V 
program table as explained in Figure 6, and during re- 

5 production, the system controller 306 analyzes the vid- 
eo descriptor table, the video program table, the audio 
data descriptor table, and the A/V program table, as ex- 
plained in Figure 7, and provides controls so that audio 
data units and video data units a user wants can be re- 

10 produced. 

[0079] During recording, the recording/reproducing 
controller 312 provides controls so that audio data 
streams formed by coded audio data units provided by 
the audio signal processor 304 and video data streams 

15 formed by coded video data units provided by the video 
signal processor 31 0, can be recorded in predetermined 
locations of the recording medium 314, and a video data 
unit descriptor table, a video program descriptor table, 
an audio data unit descriptor table, and an A/V program 

20 descriptor table provided by the system controller 306, 
in predetermined locations of the recording medium 
314. During reproduction, the recording/reproducing 
controller 312 reads audio data streams and video data 
streams recorded in the recording medium 31 4, and pro- 

25 vides the streams to the audio signal processor 304 and 
the video signal processor 310, respectively, and reads 
the video program descriptor table, the video data unit 
descriptor table, the A/V program descriptor table, and 
the audio data unit descriptor table recorded in the re- 

30 cording medium 314, and provides them to the system 
controller 306. 

[0080] The present invention enables audio data, 
which is recorded separately from video data having an 
independent structure which is used for a video record- 

35 ing/reproducing apparatus, to be linked to the video data 
and to reproduce the audio and video data. Also, using 
predetermined data of a video data unit descriptor re- 
corded in an audio program descriptor table, even after 
the video recording/reproducing apparatus carries out 

40 independent recording/reproducing operations, the re- 
sult is automatically reflected in an A/V recording/repro- 
ducing apparatus so that normal reproduction can be 
performed. 

In the case of a slide show, for example, a video 
45 recording/reproducing apparatus (for example, a video 
input processor 308, a video signal processor 310, a re- 
cording/reproducing controller 312, a memory 318, and 
video output processor 320 in Figure 8) records still pic- 
tures in the form of video data units, and then corre- 
50 sponding video data unit descriptors store recording 
times of still pictures. 

[0081] An A/V recording/reproducing apparatus (an 
audio input processor 302, an audio signal processor 
304, a recording/reproducing controller 312, and an au- 
55 dio output processor 31 6) input audio data, records the 
audio data in the form of audio data units, and informa- 
tion on the units are recorded in the corresponding audio 
data unit descriptors. 
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[0082] A user designates audio data units and video 
data units corresponding to still pictures that the user 
wants. The A/V recording/reproducing apparatus 
records information on the designated audio and video 
data units in the corresponding A/V program descriptors 
in the form of audio data unit descriptors and video data 
unit descriptors. The recording times of the video data 
unit descriptors are recorded in an AA/ program descrip- 
tor table. 

[0083] The AA/ recording/reproducing apparatus 
reads the corresponding A/V program descriptors, 
reads audio data descriptors linked to the A/V program 
descriptors, and finds and reproduces the correspond- 
ing audio data. At the same time, the apparatus reads 
video data descriptors linked to the A/V program de- 
scriptors and reproduces the still pictures which corre- 
spond to the video data. 

[0084] Before or during reproduction, it is determined 
whether or not the corresponding video data is the same 
as that wanted by the program, by comparing the re- 
cording time of the corresponding video data unit de- 
scriptor recorded in the A/V program descriptor table 
and the recording time in the actual video data unit de- 
scriptor. When these values are the same, reproduction 
is performed; otherwise reproduction is withheld, or the 
recording time of the video data unit descriptor in an N 
V program descriptor table linked to the video data unit 
descriptor which was found to be different is modified. 
[0085] Figure 9 is a flowchart showing an embodiment 
of a recording method for recording information for link- 
ing audio data to video data according to the present 
invention. The first video data to be linked to the corre- 
sponding program is selected in step S101 . Information 
on the video data unit descriptor of a video data unit hav- 
ing the corresponding video data is recorded in the cor- 
responding A/V program descriptor in step S102. Pre- 
determined information which can be used to find the 
corresponding video data in the corresponding video 
data unit (for example, information on the recording time 
of a video data unit) is recorded in step S1 03. 
The predetermined information in the corresponding 
video data unit descriptor is recorded in the A/V program 
descriptor table in step S104. It is determined whether 
or not video data linked to the A/V program is the last 
one, and if it is the last one, the process is finished in 
step S105. Otherwise, the next video data to be linked 
to the corresponding program is selected in step S106 
and then steps S102 through S105 are repeated. 
[0086] In the method shown in Figure 9, audio data 
and video data are recorded on a recording medium in 
the form of audio data units and video data units, re- 
spectively. 

When information on the audio data and video data (a 
video data descriptor table, a video program descriptor 
table, an audio data descriptor table, and an A/V pro- 
gram descriptor table) is recorded on the recording me- 
dium, information for linking audio data and video data 
is generated and recorded in an A/V program descriptor 



table. 

Figure 10 is a flowchart showing an embodiment 
of a method for updating information linking audio data 
to video data according to the present invention. Infor- 

5 mation on the first video data unit descriptor recording 
predetermined information is read from an A/V program 
descriptor table in step S201 . The corresponding video 
data unit descriptor is read from a video data descriptor 
table in step S202. Predetermined information recorded 

10 in the A/V program descriptor table is compared to the 
value recorded in the video data unit descriptor in step 
S203. It is determined whether or not the two values are 
same and when the values are not the same, the pre- 
determined information is modified so that all links of the 

15 A/V program descriptor table linked to the correspond- 
ing video data unit descriptor can be updated in step 
S205. When the values are the same, it is determined 
whether or not the video data unit descriptor is the last 
one of which predetermined information is recorded in 

20 the A/V program descriptor table in step S206. 

[0087] If it is the last one, the process is finished; oth- 
erwise, the next video data unit descriptor having pre- 
determined information is read in the A/V program de- 
scriptor table in step S207, and the steps S202 through 

25 S206 are repeated. 

The method for updating information linking audio 
data to video data shown in Figure 1 0 can be performed 
before or during reproduction. 
[0088] Figure 11 is a flowchart showing an embodi- 

30 ment of a method for linking and then reproducing audio 
and video data according to the present invention. The 
corresponding A/V program descriptor is read from an 
A/V program descriptor table in step S301. information 
on the first audio data unit descriptor linked to the A/V 

35 program is read from the A/V program descriptor in step 
S302. The corresponding audio data unit descriptor is 
read from an audio data descriptor table in step S303. 
The audio data unit indicated by the audio data unit de- 
scriptor is read and reproduced in step S305. It is deter- 

40 mined whether or not the audio data unit is the last one 
linked to the program in step S306. If it is the last one, 
the process is finished; otherwise information on the 
next audio data unit descriptor linked to the A/V program 
is read from the A/V program descriptor in step S307, 

45 and then the steps S302 through S306 are repeated. 
[0089] Meanwhile, it is determined whether or not vid- 
eo data linked to the A/V program exists when the steps 
S302 through S307 are performed, in step S308. When 
such video data exists, information on video data unit 

so descriptors having the first video data linked to the A/V 
program is read from the A/V program descriptor in step 
S309. Video data unit descriptors are read from the vid- 
eo data descriptor table in step S31 0. Video data linked 
to the A/V program is read from the data units indicated 

55 by the video data unit descriptor and stored in a memory 
in step S311. 

[0090] It is determined whether or not video data 
linked to the A/V program still exists in step S31 2. If such 
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video data still exists, information on the video data unit 
descriptors having the next video data linked to the A/V 
program are read from the A/V program descriptor in 
step S313, and then steps S310 through S312 are re- 
peated. If video data linked to the AN program does not 
exist in the step S312, stored video data is reproduced 
after adjusting its timing to that of audio data in step 
S314, and then the process is finished. 
[0091] As described above, the present invention en- 
ables the generation of a new application linking two in- 
dependent data structures, using the independent data 
structures for respective independent applications. By 
doing so, two different types of data that cannot be mul- 
tiplexed to each other can be related to each other so 
that recording, editing and reproduction are enabled. Al- 
so, the present invention enables the reproduction of a 
song recorded in the form of audio data together with 
still picture data, video data, recorded separately from 
the audio data. 

[0092] The reader's attention is directed to all papers 
and documents which are filed concurrently with or pre- 
vious to this specification in connection with this appli- 
cation and which are open to public inspection with this 
specification, and the contents of all such papers and 
documents are incorporated herein by reference. 
[0093] All of the features disclosed in this specifica- 
tion (including any accompanying claims, abstract and 
drawings), and/or all of the steps of any method or proc- 
ess so disclosed, may be combined in any combination, 
except combinations where at least some of such fea- 
tures and/or steps are mutually exclusive. 
[0094] Each feature disclosed in this specification (in- 
cluding any accompanying claims, abstract and draw- 
ings), may be replaced by alternative features serving 
the same, equivalent or similar purpose, unless ex- 
pressly stated otherwise. Thus, unless expressly stated 
otherwise, each feature disclosed is one example only 
of a generic series of equivalent or similar features. 
[0095] The invention is not restricted to the details of 
the foregoing embodiment(s). The invention extend to 
any novel one, or any novel combination, of the features 
disclosed in this specification (including any accompa- 
nying claims, abstract and drawings), or to any novel 
one, or any novel combination, of the steps of any meth- 
od or process so disclosed. 



Claims 

1. A recording medium on which is recorded a data 
structure comprising: 

first data (31) and second data (41) which are 
different to each other in type and formed of a 
plurality of data units; 

a first data unit descriptor table (32) and a sec- 
ond data unit descriptor table (42) in which in- 



formation on the first data units and the second 
data units are respectively recorded as data 
unit descriptors; and 

5 a first program descriptor table (33) and a sec- 

ond program descriptor table (43) in which in- 
formation on one or more data units forming re- 
spective programs are stored in the program 
descriptor of the corresponding program in the 

10 form of information on respective data unit de- 

scriptors, wherein information on the first data 
units, which are wanted by a user to reproduce 
after the first data units are linked to the second 
data units, is included in the program descriptor 

15 of the second program descriptor table. 

2. The recording medium of claim 1 , wherein when in- 
formation on the first data unit in the second pro- 
gram descriptor table (43) is not the same as the 

20 corresponding information on the first data unit in 
the first data unit descriptor, information on the first 
data unit in the second program descriptor table 
(43) is updated so that the information is the same 
as information on the first data unit in the first data 

25 unit descriptor. 

3. A recording method comprising the steps of: 

(a) recording first data (31) and second data 
30 (41), which are different to each other in type 

and formed of a plurality of data units, on a re- 
cording medium; and 

(b) recording a first data unit descriptor table 
35 (32) and a second data unit descriptor table 

(42) wherein information on the first data units 
and the second data units is stored as data unit 
descriptors; and a first program descriptor table 
(33) and a second program descriptor table 

40 (43) wherein information on one or more data 

units forming respective programs are stored 
as the program descriptor of the corresponding 
program in the form of information on respec- 
tive data unit descriptors, on the recording me- 

45 dium, wherein information on the first data unit, 

which is wanted by a user to reproduce after 
the first data unit is linked to the second data 
unit, is included in the program descriptor of the 
second program descriptor table. 

50 

4. The recording method of claim 3, further comprising 
the steps of: 

(c) determining whether or not information on 
55 the first data unit in the second program de- 
scriptor table (43) is the same as information 
on the first data unit in the first data unit descrip- 
tor; and 
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(d) when the two information are not the same, 
updating information on the first data unit in the 
second program descriptor table (43) so that it 
becomes the same as information on the first 
data unit in the first data unit descriptor, and re- 5 
cording the updated information. 

5. A reproducing method for reproducing data from a 
recording medium on which first data (31 ) and sec- 
ond data (41) which are different to each other in w 
type and formed of a plurality of data units are re- 
corded; a first data unit descriptor table (32) and a 
second data unit descriptor table (42), in which in- 
formation on the first data units and the second data 
units are respectively stored as data unit descrip- is 
tors, are recorded; and a first program descriptor 
table (33) and a second program descriptor table 
(43) in which information on one or more data units 
forming respective programs are stored in the pro- 
gram descriptor of the corresponding program in 20 
the form of information on respective data unit de- 
scriptors, wherein in the program descriptor of the 
second program table information for linking the first 
data and the second data are recorded, the repro- 
ducing method comprising the steps of: 25 

(a) reading the second program descriptor hav- 
ing information on the program wanted to re- 
produce, and then reading information the first 
data unit descriptor and the second data unit 30 
descriptor related to the corresponding pro- 
gram, from the read second program descrip- 
tor; 

(b) reading the corresponding data unit descrip- 35 
tors from the first and second data descriptor 
tables corresponding to the read first and sec- 
ond data unit descriptors; and 

(c) synchronizing and reproducing the first data 40 
unit and the second data unit indicated by the 
read first and second data unit descriptors. 



comprising the steps of: 

(d) determining whether or not information on 
the first data unit in the second program de- 
scriptor table is the same as information on the 
first data unit in the first data unit descriptor; and 

(e) when the two information are not the same, 
updating information on the first data unit in the 
second program descriptor table (43) so that it 
becomes the same as information on the first 
data unit in the first data unit descriptor, and re- 
cording the updated information. 

8. The reproducing method of claim 5 or 6, further 
comprising the steps of: 

(d) determining whether or not information on 
the first data unit in the second program de- 
scriptor table (43) is the same as information, 
which corresponds to the information on the 
first data unit, on the first data unit in the first 
data unit descriptor; and 

(e) when the two information are not the same, 
reproducing the second data unit while with- 
holding reproduction of the first data unit, 

9. A recording apparatus for recording data of different 
types on a recording medium, the recording appa- 
ratus comprising: 

a first signal processor (1 08, 1 1 0) for formatting 
a first data stream input into independent units, 
coding the formatted first data units, and pro- 
viding them to the recording medium; 

a second signal processor (102, 104) for for- 
matting a second data stream input into inde- 
pendent units, coding the formatted second da- 
ta units, and providing them to the recording 
medium; and 



6. The reproducing method of claim 5, wherein the 
step (c) further comprises the sub-steps of: 45 

(c1) temporarily storing the first data units indi- 
cated by the first data unit descriptors corre- 
sponding to the wanted program, to a memory; 
and 50 
(c2) reproducing the second data units indicat- 
ed by the second data unit descriptors corre- 
sponding to the wanted program, and at the 
same time synchronizing, to the second data, 
and reproducing the first data units after read- 55 
ing the first data units stored in the memory. 

7. The reproducing method of claim 5 or 6, further 



a system controller (106) for generating a first 
data unit descriptor table and a second data 
unit descriptor table in which information on the 
first data units and the second data units are 
respectively stored as data unit descriptors; 
and a first program descriptor table and a sec- 
ond program descriptor table in which informa- 
tion on one or more data units forming respec- 
tive programs are stored in the program de- 
scriptor of the corresponding program in the 
form of information on respective data unit de- 
scriptors, wherein information on the first data 
unit, which is wanted by a user to reproduce 
after linked to the second data unit, is included 
in the program descriptor of the second pro- 
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gram descriptor table. 

10. The recording medium of claim 1, the recording 
method of claim 3, or the recording apparatus of 
claim 9, wherein predetermined information of the 5 
first data unit descriptor, as information on the first 
data unit, is copied to the program descriptor of the 
second program descriptor table. 

1 1 . A reproducing apparatus for reproducing data from 10 
a recording medium on which first data and second 
data, which are different to each other in type and 
formed of a plurality of data units, are recorded; a 
first data unit descriptor table and a second data unit 
descriptor table, which include data unit descriptors »5 
having information on respective data units, are re- 
corded; and a first program descriptor table and a 
second program descriptor table in which informa- 
tion on one or more data units forming respective 
programs are stored in the program descriptor of 20 
the corresponding program in the form of informa- 
tion on respective data unit descriptors, are record- 
ed, wherein information for linking the first data and 

the second data is recorded in the program descrip- 
tor of the second program table, the reproducing ap- 25 
paratus comprising: 

a system controller (206) for reading the sec- 
ond program descriptor having information on 
the program wanted by a user to reproduce, 30 
reading information on the first data unit de- 
scriptor and the second data unit descriptor re- 
lated to the corresponding program from the 
read second program descriptor, and reading 
corresponding data unit descriptors from the 35 
first data descriptor table and the second data 
descriptor table corresponding respectively to 
read information on the first data unit descriptor 
and the second data unit descriptor; 

40 

a first signal processor (21 2) having an embed- 
ded memory (214), and for temporarily storing 
the corresponding first data unit indicated by 
the read first data unit descriptor to the memory 
(214), decoding the first data unit stored in the 45 
memory (214), and reproducing the decoded 
first data after adjusting its timing to that of the 
second data unit; and 

a second signal processor (208) for decoding 50 
the corresponding second data unit indicated 
by the read second data unit descriptor and re- 
producing the decoded second data. 

12. An audio-reproduction-dedicated apparatus for re- 55 
producing data from a recording medium on which 
first data and second data which are different to 
each other in type and formed of a plurality of data 



units are recorded; a first data unit descriptor table 
and a second data unit descriptor table, which in- 
clude data unit descriptors having information on re- 
spective data units, are recorded; and a first pro- 
gram descriptor table and a second program de- 
scriptor table in which information on one or more 
data units forming respective programs are stored 
in the program descriptor of the corresponding pro- 
gram in the form of information on respective data 
unit descriptors, are recorded, wherein information 
for linking the first data and the second data is re- 
corded in the program descriptor of the second pro- 
gram table, the audio-reproduction-dedicated ap- 
paratus comprising: 

a system controller for reading the second pro- 
gram descriptor having information on the pro- 
gram wanted by a user to reproduce, reading 
information on the second data unit descriptor 
related to the corresponding program from the 
read second program descriptor, and reading 
corresponding data unit descriptors from the 
second data descriptor table corresponding to 
read information on the second data unit de- 
scriptor; and 

a signal processor for decoding the corre- 
sponding data unit indicated by the read sec- 
ond data unit descriptor and reproducing the 
second data. 

13. A recording/reproducing apparatus comprising: 

a first signal processor (310) for formatting a 
first data input into independent units and cod- 
ing the formatted first data units during record- 
ing; and for temporarily storing the correspond- 
ing data unit indicated by the read first data unit 
descriptor to an embedded memory, decoding 
the first data unit read from the memory, and, 
during reproduction, reproducing the decoded 
first data after adjusting its timing to that of a 
second data unit; 

a second signal processor (304) for formatting 
a second data input into independent units and 
coding the formatted second data units during 
recording; and, during reproduction, for decod- 
ing the corresponding second data unit indicat- 
ed by the read second data unit descriptor and 
reproducing the decoded second data; and 

a system controller (306) for generating a first 
data unit descriptor table and a second data 
unit descriptor table storing information on the 
first data units and the second data units as da- 
ta unit descriptors, and a first program descrip- 
tor table and a second program descriptor table 
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in which information on one or more data units 
forming respective programs are stored in the 
program descriptor of the corresponding pro- 
gram in the form of information on respective 
data unit descriptors wherein information on the s 
first data unit wanted to reproduce after linked 
to the second data unit is included in the pro- 
gram descriptor of the second program descrip- 
tor table, during recording; and, during repro- 
duction, for reading the second program de- 
scriptor having information on the program 
wanted to reproduce, reading information on 
the first data unit descriptor and the second da- 
ta unit descriptor related to the corresponding 
program from the read second program de- 
scriptor, and reading corresponding data 
stream unit descriptors from the first data de- 
scriptor table and the second data descriptor 
table corresponding respectively to read infor- 
mation on the first data unit descriptor and the 
second data unit descriptor. 

14. The recording medium of claim 1, the recording 
method of claim 3, the reproducing method of claim 
5, the recording apparatus of claim 9, the reproduc- 
ing apparatus of claim 11 or the recording/reproduc- 
ing apparatus of claim 13, wherein the first data is 
video data of still pictures and the second data is 
audio data. 

1 5. The reproducing method of claim 5, the reproducing 
apparatus of claim 11, or the recording/reproducing 
apparatus of claim 13, wherein information on the 
first data unit which is wanted by a user to reproduce 
after the first data unit is linked to the second data 
unit is stored, as linkage information, in the program 
descriptor of the second descriptor table, and pre- 
determined information in the first data unit descrip- 
tor is copied, as information on the first data unit, to 
the program descriptor of the second descriptor ta- 
ble. 



on the first data unit in the second program descrip- 
tor table is updated so that the information is the 
same as information on the first data unit in the first 
data unit descriptor. 

18. The reproducing apparatus of claim 11, or record- 
ing/reproducing apparatus of claim 13, wherein the 
system controller determines whether or not infor- 
mation on the first data unit in the second program 
descriptor table is the same as the corresponding 
information on the first data unit in the first data unit 
descriptor, and, when two information are not the 
same, the second data unit is reproduced while the 
reproduction of the first data unit is withheld. 

19. The reproducing apparatus of claim 11 or the re- 
cording/reproducing apparatus of claim 1 3, wherein 
the memory is installed outside the first signal proc- 
essor. 
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16. The recording medium of claim 1, the recording 
method of claim 3, the reproducing method of claim 

15, the recording apparatus of claim 10, the repro- *5 
ducing apparatus of claim 1 5 or the recording/re- 
producing apparatus of claim 13, wherein the pre- 
determined information is information on recording 
time of the first data unit. 

50 

17. The recording apparatus of claim 10, the reproduc- 
ing apparatus of claim 11 or the recording/reproduc- 
ing apparatus of claim 1 3, wherein the system con- 
troller determines whether or not information on the 
first data unit in the second program descriptor table 55 
is the same as the corresponding information on the 
first data unit in the first data unit descriptor, and, 
when two information are not the same, information 
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